Episode Adaptive Embedding Networks for Few-Shot Learning
نویسندگان
چکیده
Few-shot learning aims to learn a classifier using few labelled instances for each class. Metric-learning approaches few-shot embed into high-dimensional space and conduct classification based on distances among instance embeddings. However, such embeddings are usually shared across all episodes thus lack the discriminative power generalize classifiers according episode-specific features. In this paper, we propose novel approach, namely \emph{Episode Adaptive Embedding Network} (EAEN), of instances. By leveraging probability distributions in an episode at channel-pixel embedding dimension, EAEN can not only alleviate overfitting issue encountered tasks, but also capture features specific episode. To empirically verify effectiveness robustness EAEN, have conducted extensive experiments three widely used benchmark datasets, under various combinations different generic backbones classifiers. The results show that significantly improves accuracy about $10\%$ $20\%$ settings over state-of-the-art methods.
منابع مشابه
Prototypical Networks for Few-shot Learning
A recent approach to few-shot classification called matching networks has demonstrated the benefits of coupling metric learning with a training procedure that mimics test. This approach relies on an attention scheme that forms a distribution over all points in the support set, scaling poorly with its size. We propose a more streamlined approach, prototypical networks, that learns a metric space...
متن کاملFew-Shot Learning with Graph Neural Networks
We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic message-passing inference algorithms with their neural-network counterparts, we define a graph neural network architecture that generalizes several of the recentl...
متن کاملGaussian Prototypical Networks for Few-Shot Learning on Omniglot
We propose a novel architecture for k-shot classification on the Omniglot dataset. Building on prototypical networks, we extend their architecture to what we call Gaussian prototypical networks. Prototypical networks learn a map between images and embedding vectors, and use their clustering for classification. In our model, a part of the encoder output is interpreted as a confidence region esti...
متن کاملFew-shot Learning
Though deep neural networks have shown great success in the large data domain, they generally perform poorly on few-shot learning tasks, where a classifier has to quickly generalize after seeing very few examples from each class. The general belief is that gradient-based optimization in high capacity classifiers requires many iterative steps over many examples to perform well. Here, we propose ...
متن کاملImitation networks: Few-shot learning of neural networks from scratch
In this paper, we propose imitation networks, a simple but effective method for training neural networks with a limited amount of training data. Our approach inherits the idea of knowledge distillation that transfers knowledge from a deep or wide reference model to a shallow or narrow target model. The proposed method employs this idea to mimic predictions of reference estimators that are much ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2021
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-030-75768-7_1